A Layer Decomposition-Recomposition Framework for Neuron Pruning towards Accurate Lightweight Networks

Neuron pruning is an efficient method to compress the network into a slimmer one for reducing the computational cost and storage overhead. Most of state-of-the-art results are obtained in a layer-by-layer optimization mode. It discards the unimportant input neurons and uses the survived ones to reconstruct the output neurons approaching to the original ones in a layer-by-layer manner. However, an unnoticed problem arises that the information loss is accumulated as layer increases since the survived neurons still do not encode the entire information as before. A better alternative is to propagate the entire useful information to reconstruct the pruned layer instead of directly discarding the less important neurons. To this end, we propose a novel Layer Decomposition-Recomposition Framework (LDRF) for neuron pruning, by which each layer's output information is recovered in an embedding space and then propagated to reconstruct the following pruned layers with useful information preserved. We mainly conduct our experiments on ILSVRC-12 benchmark with VGG-16 and ResNet-50. What should be emphasized is that our results before end-to-end fine-tuning are significantly superior owing to the information-preserving property of our proposed framework.With end-to-end fine-tuning, we achieve state-of-the-art results of 5.13x and 3x speed-up with only 0.5% and 0.65% top-5 accuracy drop respectively, which outperform the existing neuron pruning methods.Comment: accepted by AAAI19 as ora

Radar-assisted Predictive Beamforming for Vehicle-to-Infrastructure Links

In this paper, we propose a radar-assisted predictive beamforming design for vehicle-to-infrastructure (V2I) communication by relying on the joint sensing and communication functionalities at road side units (RSUs). We present a novel extended Kalman filtering (EKF) framework to track and predict kinematic parameters of the vehicle. By exploiting the radar functionality of the RSU we show that the communication beam tracking overheads can be drastically reduced. Numerical results have demonstrated that the proposed radar-assisted approach significantly outperforms the communication-only feedback based technique in both the angle tracking and the downlink communication.Comment: 6 pages, 3 figures, accepted by IEEE ICC 2020. arXiv admin note: substantial text overlap with arXiv:2001.0930

Low-complexity iterative receiver design for high spectral efficiency communication systems

University of Technology Sydney. Faculty of Engineering and Information Technology.With the rapid development of the modern society, people have an increasing demand of higher data rate. Due to the limited available bandwidth, how to improve the spectral efficiency becomes a key issue in the next generation wireless systems. Recent researches show that, compared to the conventional orthogonal communication systems, the non-orthogonal system can transmit more information with the same resources by introducing non-orthogonality. The non-orthogonal communication systems can be achieved by using faster-than-Nyquist (FTN) signaling to transmit more data symbols in the same time period. On the other hand, by designing appropriate codebook, the sparse code multiple access (SCMA) system can support more users while preserving the same resource elements. Utilisation of these new technologies leads to challenge in receiver design, which becomes severer in complex channel environments. This thesis studies the receiver design for high spectral efficiency communication systems. The main contributions are as follows: 1. A hybrid message passing algorithm is proposed for faster-than-Nyquist, which solves the problem of joint data detection and channel estimation when the channel coefficients are unknown. To fully exploit the known ISI imposed by FTN signaling, the interference induced by FTN signaling and channel fading are intentionally separated. 2. Gaussian message passing and variational inference based estimation algorithms are proposed for faster-than-Nyquist signaling detection in doubly selective channels. Iterative receivers using mean field and Bethe approximations based on variational inference framework are proposed. Moreover, a novel Gaussian message passing based FTN signaling detection algorithm is proposed. 3. An energy minimisation based SCMA decoding algorithm is proposed and convergence analysis of the proposed algorithm is derived. Following optimisation theory and variational free energy framework, the posterior distribution of data symbol is derived in closed form. Then, the convergence property of the proposed algorithm is analysed. 4. A stretched factor graph is designed for MIMO-SCMA system in order to reduce the receiver complexity. Then, a convergence guaranteed message passing algorithm is proposed by convexifying the Bethe free energy. Finally, cooperative communication methods based on belief consensus and alternative direction method of multipliers are proposed. 5. A low complexity detection algorithm is proposed for faster-than-Nyquist SCMA system, which enables joint channel estimation, decoding and user activity detection in grant-free systems. The combination of FTN signaling with SCMA to further enhance the spectral efficiency is first considered. Then, a merging belief propagation and expectation propagation algorithm is proposed to estimate channel state and perform SCMA decoding

A Hybrid BP-EP-VMP Approach to Joint Channel Estimation and Decoding for FTN Signaling over Frequency Selective Fading Channels

This paper deals with low-complexity joint channel estimation and decoding for faster-than-Nyquist (FTN) signaling over frequency selective fading channels. The inter-symbol interference (ISI) imposed by FTN signaling and the frequency selective channel are intentionally separated to fully exploit the known structure of the FTN-induced ISI. Colored noise due to the faster sampling rate than that of the Nyquist signaling system is approximated by autoregressive process. A Forney style factor graph representation of the FTN system is developed and Gaussian message passing is performed on the graph. Expectation propagation (EP) is employed to approximate the message from channel decoder to Gaussian distribution. Since the inner product between FTN symbols and channel coefficients is infeasible by belief propagation (BP), we propose to perform variational message passing (VMP) on an equivalent soft node in factor graph to tackle this problem. Simulation results demonstrate that the proposed low-complexity hybrid BP-EP-VMP algorithm outperforms the existing methods in FTN system. Compared with the Nyquist counterpart, FTN signaling with the proposed algorithm is able to increase the transmission rate by over 40%, with only negligible BER performance loss

Joint Radar-Communication-Based Bayesian Predictive Beamforming for Vehicular Networks

In this paper, we develop a predictive beamforming scheme based on the dual-functional radar-communication (DFRC) technique, where the road-side units estimates the motion parameters of vehicles exploiting the echoes of the DFRC signals. Compared to the conventional feedback-based beam tracking approaches, the proposed method can reduce the signaling overhead and improve the tracking performance. A novel message passing algorithm is proposed, which yields a near optimal performance achieved by the maximum a posteriori estimation. Simulation results have shown the effectiveness of the proposed DFRC based scheme.Comment: IEEE RadarConf 202